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@ 3-D multiple view window. 

(57) A method and apparatus is provided for divid- 
ing a display screen into distinct areas in which 
different display images can be viewed at the 
same time. Direct manipulation techniques are 
provided to enable a user to access the different 
display images. A six-sided three dimensional 
window is disclosed which allows six views of 
an object. Direct manipulation user techniques 
in the fomri of drag operations are provided to 
toggle between any of the six views by dragging 
a positron Indicator (e.g. cursor) over the bor- 
ders of the window using a pointing device (e.g. 
mouse). Rotation of the views is achieved by 
dragging the position indicator over the corners 
of the window. 
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This invention relates to a method and apparatus 
for dividing a display screen into distinct areas in 
which different display images can be viewed at the 
same time, and more particularly, to the creation of 
a three-dimensional multiple view window which per- 
mits the switching of displayed images using direct 
manipulation techniques. 

The usefulness of computer systems is directly 
related to a user's ability to communicate effectively 
and efficiently with the computer system. Central to 
this ability to communicate is the need to have a com- 
prehensive display of images available to the user of 
work objects being operated upon In an Interactive 

One approach at accomplishing this goal con- 
sists of dividing the display screen into split panels 
(e.g. split screen) and spreading information overthe 
split panels. For example, the display screen may be 
split into two equally sized display panels and ar- 
ranged so that the split panels abut each other in a 
manner similar to portions of an opened book. A cur- 
sor image/pointer (e.g. position indicator) coupled to 
a pointing device (e.g. a mouse) may be used to ac- 
cess the information in a serial manner in each of the 
split panels. A variation on this approach provides a 
front-end menu/dialog that controls access to the giv- 
en panels. 

Another approach calls for overlapping segment- 
ed areas of a display area in much the same way as 
piling a stack of books on a desk. In this approach, the 
most recently used or "active" window would appear 
on the top (e.g. view not obscured by other windows) 
and the least recently used window would appear on 
the bottom. A user is unable, using the known ap- 
proaches, to use direct manipulation techniques to 
change the displayed images. For example, a user 
wishing to replace the current view (e.g. switch from 
an Iconic view of a list to a textual view) of an object 
must either replace the current view or open a new 
window to a new view using multiple combinations of 
keyboard strokes or mouse manipulations in conjunc- 
tion with menu bars. A user cannot, using the direct 
manipulation technique known as a drag operation, 
switch to a new view while maintaining the current 
view. Drag as used herein describes the moving of a 
pattern, image or shape using a cursor image coupled 
to a pointing device. 

Consequently, what is needed is an apparatus 
and method for dividing a display screen into distinct 
areas in which different displayed images can be 
viewed at the same time and provide direct manipu- 
lation techniques for changing the view of different 
images. 

This Invention relates to a method and apparatus 
for dividing a display screen into distinct areas in 
which different display images can be viewed at the 
same time. Direct manipulation techniques may then 
be applied to enable a user to access the different dis- 



play images. A six-sided six dimensional window is 
disclosed which allows up to three simultaneous 
views of an object. Direct manipulation user controls 
are provided to toggle between any of the six simul- 
5 taneous views by dragging a position indicator (e.g. 
cursor) over the borders of the window using a point- 
ing device (e.g. mouse). Rotation of the views is also 
provided by dragging the positran indicator over the 
corners of the window. 
10 Figure 1 is a block diagram of a data processing 

system where this invention may be practiced. 

Figure 2 is a wire frame representation of a win- 
dow created by this invention. 

Figure 3 demonstrates the use of a two-sided 
15 view in a two dimensional implementation. 

Figure 4 demonstrates how to rotate information 
in a two dimensional implementation. 

Figure 5 demonstrates how to rotate information 
using the invention in a three dimensional implemen- 
20 tation. 

Figure 6 demonstrates the use of the invention in 
a three dimensional implementation using direct ma- 
nipulation techniques. 

Figure 7 is a flow diagram demonstrating manip- 

25 ulation of a two-sided window In a two-dimensional 
implementation. 

Figures 8 and 9 are flow diagrams demonstrating 
manipulation of a six-sided window in a three- 
dimensional implementation. 

30 With reference now to the figures, and in partic- 
ular with reference to Figure 1, there is depicted a pic- 
torial representation of data processing system 10 
which may be utilized to implementthe method of the 
present invention. As may be seen, data processing 

35 system 10 may include a processor unit 18 having a 
central processing unit 22 (CPU) coupled to relatively 
fast memory 20. Of course, those skilled in the art will 
appreciate that a plurality of user Input/Output devic- 
es may be connected to the processor unit 18 includ- 

40 ing a keyboard 26 for manual entry of information, a 
display 28 for presenting the output of a computer 
program, a printer 24, and a pointing device such as 
a mouse 30. 

As is common in such data processing systems, 

45 auxiliary storage may be provided in the form of fixed 
hard disk storage 12 and/or floppy disk device 14. Re- 
movable media in the form of a diskette 16 may be 
used to input a computer program into the data proc- 
essing system 10 via the floppy disk device 14. It 

50 should be understood that the method disclosed by 
this invention may be described in a computer pro- 
gram product and inputted in the manner described 
above. 

Turning now to Figure 2, a six-sided window 40 
55 as disclosed by this invention is shown. The window 
40 is capable of six different views. The heavy black 
borders 43 indicate the views currently viewable by 
a user while the dotted lines 45 indicate views that are 



2 



EP 0 547 993 A2 



4 



hidden. Orientation of the window 40 as shown in Fig- 
ure 2, results in View A 42 being the "active" window. 
An active window is defined as a currently viewable 
window in which the user can update or change the 
information therein using one of the I/O devices (e.g. 
keyboard, mouse, etc). Still referring to Figure 2, 
Views B 44 and E 46 are shown shadowed. Unlike the 
active View A 42, the shadowed views while currently 
viewable are incapable of being changed/updated by 
the user. Forthe purpose of this invention, shadowing 
refers to non-active views in a three-dimensional win- 
dow which are currently viewable and shown in per- 
spective. Views C 48, D 50, and F 52 are hidden from 
view when the window is oriented as shown. How- 
ever, the views are easily accessible using direct ma- 
nipulating techniques which will be described later. 

With reference to Figure 3, presentation of the 
two-sided window on a two-dimensional display will 
be described. Analog clock View 60 and digital clock 
View 70 reside on adjacent views of the three- 
dimensional window. Analog clock View 60 is com- 
posed of a clock face image 62 indicating 3 P.M. Like- 
wise, digital clock View 70 is shown composed of a 
digital image synchronized with the analog clock 
View 60. The borders of the window for analog clock 
View 60 are shown as "Border A" to the left and "Bor- 
der B" to the right. A cursor 64 is shown super-im- 
posed on "Border A". In order to "flip" the analog clock 
View 60 to show the digital clock View 70, the cursor 
64 is placed on border A and a drag operation is done 
across border B. This operation causes the analog 
clock View 60 to flip over revealing the digital clock 
View 70. Those skilled in the art will recognize that a 
system developer may decide to allow only one view 
of a given object or contextually only one view should 
be allowed at the current time. The current invention 
is easily modified so that if a user finds that physical 
constraints prohibit movement of one window border 
across the opposite border, a drag operation may be 
allowed to provide only a smaller window. However, 
if two views are supported, the result of the drag 
would be a re-sized window with the view from the op- 
posite side of the window shown. 

Using direct manipulation drag operations, vari- 
ous orientations of a video image may be described 
through the use of this invention. With reference to 
Figure 4, three orientations of the letter "Q" are 
shown. As shown generally at 80, the normal orien- 
tation of the letter Q 82 may be stored as one view 
while its "reversed and upside down" orientation 84 
may be stored as a second view. The "reversed" letter 
Q 86 may be stored as yet a third view with the three 
views being accessed in the following manner. Plac- 
ing the mouse cursor at "Border A" and dragging it 
across "Border B" would access the "reversed" View 
86 ofthe letter Q. Likewise, placing the cursor at "Cor- 
ner A" and dragging it across "Corner B" would access 
the "reversed and upside down" image 84. In this 



manner, any number of views may be added and ac- 
cessed using direct manipulation drag operations. 

Turning now to Figure 5, the use of the three- 
dimensional window for simultaneous viewing of mul- 
5 tiple images will be described. Asix-sided window 1 00 
is generally shown in Figure 5. View A 102 is the ac- 
tive view and is shown with a mouse pointer 104 su- 
per-imposed in the image area. Views B 106 and E 
108 are shown as shadowed views with Views G 110, 

10 D 114, and F 112 hidden. To display hidden View D 
114 requires the following operations. The mouse 
pointer 104 is moved into active View A 102. A drag 
operation is then performed such that the mouse 
pointer 104 is moved over the border between active 

15 View A 102 into View B 106. This results in uncovering 
previously hidden View D 1 14, as shown in the flipped 
View 1 20. An examination of flipped View 120 reveals 
that View D 114 is now the active view. Previously 
shadowed View B 1 06 is now a hidden view along with 

20 previously active View A 1 02. It should be noted that 
Views E 108 and F 112 have not changed positions. 
They would have changed positions, however, if the 
drag operation had originated at a corner. As can be 
seen, this invention represents a significant improve- 

25 ment over the prior art in its ability to show a plurality 
of images simultaneously while permitting easy ac- 
cess to hidden views through simple direct manipula- 
tion techniques. 

With reference now to Figure 6, additional em- 

30 bodiments of the invention used in a character based 
mode are shown. A presentation is shown generally 
at 140 which allows a user to view three views ofthe 
six-sided window. An index View 144, table-of-con- 
tents View 146, and a story View 142 are the current- 

35 ly viewable images. The story View 1 42 is the active 
view where a user may update/change the view. To 
access additional views, a user moves a mouse cur- 
sor 148 into the table-of-contents View 146 and per- 
forms a drag operation across the border separating 

40 the table-of-contents View 146 from the story View 
142. This operation results in access to hidden views 
such as those shown in the flipped View 1 60. The flip- 
ped View 160 shows that the table-of-contents View 
146 now becomes the active view with the story View 

45 1 42 hidden. In addition, previously hidden glossary 
View 148 has now surfaced from the back ofthe win- 
dow. As disclosed, the Invention has the flexibility to 
conform to any number of modes including the dis- 
play of graphical and text based applications. 

50 Turning now to Figure 7, manipulation ofthe two- 

sided window in two-dimensional applications will be 
further explained. A flow-diagram 170 is generally 
shown for manipulating the two-sided window in two- 
dimensional applications. At block 1 72, the data proc- 

55 easing system is initialized. Various images may then 
be opened for each of the views including graphical 
(e.g. including multimedia images or full motion vid- 
eo) or text images as shown at block 174. At block 
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1 76, a user decides if a currently hidden view siiould 
be displayed (e.g. request to look atthe reflections on 
window views). If a two-sided window is implemented 
as determined at block 178, user actions are permit- 
ted to change the current view. At block 180, a user 5 
may drag a mouse cursor across the opposite window 
of either the window border or window corner to flip 
the view and reveal a new image. It is to be under- 
stood thatthe two-sided window may be the front side 
and rear side of a window or any two adjacent sides io 
of a three-dimensional Mage. 

Turning now to Figure 8, similar operations are 
disclosed for the invention when used in a three- 
dimensional environment. System initialization for 
the data processing system occurs at block 1 92. The y5 
six views of the window are then assigned images by 
opening multlmedia/text/graphlcal objects for each of 
the six views as shown at block 194. A user at block 
196 is provided an option to change the shadowing 
proportions of the window. At block 200 the user is po 
provided an option to completely hide all views except 
the active view. When selected, the currently visible 
view is reduced to a single two-dimensional image. 
The user is also provided an option to minimize the 
shadow size as indicated at block 202. Using this op- 25 
tion, a user can vary the angles of the prospective im- 
ages thus increasing or decreasing the size of the 
non-active images. Regardless of the type of shad- 
owing proportions selected by a user, the various 
views may be easily accessed by a user as indicated 30 
at block 198 using direct manipulation techniques. 
Turning now to Figure 9, If the user elects to change 
the views, the mouse pointer must be located and 
rendered visible to the user as indicated in blocks 204 
and 214. The mouse pointer must then be positioned as 
on the window border or corner as indicated in blocks 
206 and 216. Adirect manipulation drag operation as 
shown in block 208 may then be performed which re- 
suits In flipping the view as Indicated at block 210 to 
reveal a new image as indicated in block 212. A user 40 
is permitted to repeat the drag operation until all 
views have been seen. 

In summary, this invention extends the basic win- 
dow metaphor. Traditionally, windows are assumed to 
be two-dimensional with a one-side-only view. The 45 
present invention permits a continuation of this one- 
side-oniy view but adds the capability of one to five 
additional views. A six-sided rectangular window is 
disclosed which allows up to six views. A user may 
toggle between the views using direct manipulation so 
drag operations. In addition, a two-sided view is dis- 
closed which operates in a traditional two-dimension- 
al mode which allows a user to flip from one view to 
the next by dragging a side/cornerof the window bor- 
der across the opposite border. When used in the six- 55 
sided three-dimensional mode, the invention allows 
the simultaneous viewing of three views with the 
three hidden views accessible by dragging the cursor 



from a current view to a different view. Unlike tradi- 
tional techniques which may lead to messy electronic 
desktops (e.g. overlapping windows) or the loss of 
views, the present invention allows users to see mul- 
tiple views of an object using simple drag operations. 
Furthermore, the present invention is adaptable to a 
plurality of different environments. For example, the 
invention is easily adaptable to the multimedia area 
where photo-quality images may comprise the vari- 
ous views. A user could be given access to mirror im- 
ages or the mirror image turned upside down of a 
photo by dragging the side or corner of the window. 
This type of image rotation is useful in medical diag- 
nostics, CAD/CAM, film-editing, etc. In addition, 
desktop publishing would find many uses forthe pres- 
ent invention. An editor, for example, during the prep- 
aration of a magazine edition, could use the six-sided 
window to edit a story, then drag to a view of the Ta- 
ble-of-Contents to verify title matches, then drag to 
an index or a glossary. As readily seen, the disclosed 
invention maintains current functions available in 
two-dimensional environments while adding flexibility 
and ease of use in viewing additional images using di- 
rect manipulation techniques. 



Claims 

1. A system for dividing a display screen In a data 
processing system into distinct areas to form a 
plurality of views in which different images can be 
viewed, at least one of said plurality of views cur- 
rently visible to a user, said system comprising: 
means for generating a six-sided window on said 
display screen, each side of said window repre- 
senting one of said plurality of views; and 
means Ibr storing one of a plurality of diffierent im- 
ages on each of said one of said plurality of views, 
wherein said currently visible view is changeable 
in response to inputs by said user. 

2. A system as recited In Claim 1, further compris- 
ing: 

means for storing one of a plurality of different im- 
ages on each of said one of said plurality of views, 
wherein said currently visible view is editable in 
response to inputs by said user. 

3. A system as recited in Claim 1, further compris- 
ing: 

means for generating a position indicator on said 
display screen super-imposed over said current- 
ly visible view; and 

means coupled to said position indicator means 
for moving said position indicator about said 
screen in response to inputs by said user to a 
pointing device to change said currently visible 
view. 
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4. 



A system as recited in Claim 3, wherein said pos- 
ition indicator comprises a cursor. 



14. A method as recited in Claim 10, wherein said 
pointing device is a mouse. 



5. 



A system as recited in Claim 3, wherein said 
pointing device is a mouse. 



15. A method as recited in Claim 10, wherein said 
three-dimensional window is a rectangle. 
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6. 



A system as recited in Claim 3, wherein changing 
said currently visible view is accomplished by 
grasping with a pointing device a border of said 
window. 



16. A method as recited In Claim 11, wherein chang- 
ing said currently visible view is accomplished by 
grasping with a pointing device a border of said 
window. 
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7. 



A system as recited In Claim 3, wherein changing 
said currently visible view is accomplished by 
grasping with a pointing device an edge of said 
window. 



17. Amethod as recited in Claim 11, wherein chang- 
ing said currently visible view Is accomplished by 
grasping with a pointing device an edge of said 
window. 
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8. A system as recited In Claim 1, further compris- 
ing: 

means coupled to said position Indicator means 
for varying a shadowing proportion of said win- 20 
dow In response to user movement of said point- 
ing device. 

9. A system as recited in Claim 1 , wherein said six- 
sided window is a rectangle. 2s 

10. A method of dividing a display screen on a data 
processing system into distinct areas to form a 
plurality of views in which different images can be 
viewed, said method comprising: 30 
generating a three-dimensional window on said 
display screen having a plurality of sides, each 

one of said plurality of sides representing one of 
said plurality of views; and 

storing a plurality of different images on each of 35 
said views for manipulation by a user in response 
to movement of a pointing device. 

11. Amethod as recited in Claim 10, further compris- 
ing: 40 
generating a position indicator on said display 
screen super-Imposed over a currently visible 
view, said pointing Indicator coupled to a pointing 
device for moving said pointing indicator in re- 
sponse to manipulation by said user; and 45 
changing said currently visible view to another 

one of said plurality of views In response to said 
user manipulation of said pointing indicator. 

12. Amethod as recited In Claim 10, further compris- so 
ing: 

varying a shadowing proportion of said window in 
response to user movement of said pointing de- 
vice. 

55 

13. A method as recited In Claim 11, wherein said 
position indicator is a cursor. 
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